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ABSTRACT . . « ^ 

A study, was conducted for the purpose of clarifying'' 

^decision alternatives concerning computer^assisted instruction (CAI) 
in the Merrill Library at Utah 'State University. The main research 
quesj^ions were: (1) To what extent is the CAI system in use at 
presentr (2) What^factors have encouraged or. hindered CAJ usage? Q) 
How do people feel about the system? (4) What alternative aj^proaches 
are available and how feasible are they? Tto obtain answers to these 
questions a series of fouiL questionnaires were used to poll students, 
library 3taf f , faculty u^ersr and prospective users. With the 
exception of a portion of the library staf f , * feelings expressed about 
the Ci^I system were generally positive. Negative feelings e.nqbu^ered 
were due tck mechanical difficulties. The intervie.w sessions , are 
^ummarized^the result.s of a cost^effectiveness^ study are presented; • 
and recommendations are made for future CAI use *at Mer^j.11 Library. 

.It Is^concluded that the CAI ^^tem aj)pears to have considerable 
support from users and is in a position — through anticipated 
expansion of terminal usage — to demonstrate a level of operatioiji that 
is more cost-efficient than has previously been the case. A 
simplified glossary for CAI, a brief bibliography, and the 
questionnaire^^ used in the study conclude the report'. (Authory^KKC) 
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Computer assisted instruction of^^fers an individualized, self-paced^ 
learning mode with potential Oost-e^f iciency • . . . 

f Terminals in^&he Merrill liibr^iiy were purchased in the summer of 

, 1972 as a demonstration project, and have been used mainly for 

Computer Assisted Testing (CAt^^ 2 

Initietlly, more problems with equipment breakdowns were encountered \ 
than had been anticipated, but reliability has improved considerably h 
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Financial arrangeiaents 'for use of the terminals have been arranged 

to maximize the appeal to users i ... ^ - 5 

This study involved structured interviews^ with students, library 
staff, faculty users, and potential users, asking questions about 
(l) the exjtent of CAI use; (2) factors encouraging or hinderifig 
CAI use; (3) how people feel fbout the system; and (U) possible 

etlternative approaches . . ^ . ^ . ' » • T 

* 

With the exception of a portion of the library staff ,v feelings ex- 
pressed about the CAI system were generally positive. Negative 
feelingl^encountered were due to mechanical difficulties . . . ^. . . 10 

The level of usage of the MLLKP terminals prior to fall quarteif 
19TU was loliJ^y mainly used by a single profes^s^or. Since fall 
quarter, ar number of other users have developed and implemented pro- 

gram^ ^ ■ 

> / 

A number of factors encouraging CAI 'use were noted, particularly 
"^the self-paced nature of ^ instruction , the novelty of the approach, 
and the flexibility in scheduling 12 

Mechanical complaints were clearly the major factor discouraging 

CAI use, aJLthough 'some additional, factors were cited . . ^- . . . . 13 

Many suggested improvements ^follow from the factors discouraging 
•use, such as (l) upgrade mechgjiical reliability; (2) simplify, 
instoiiietions to students; (3) offer a wo:^kshop for potential faculty 
users 

Some additional suggestions^ere considered noteworthy^ e.g. 

(1) run"^ independent telephone line to eliminate monthly* charges ;^ 

(2) use the present administrative terminals for CAI on a shared ] 
time basis » • . . • 
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Cost-benefit calculations give an estimate of efficiency, but do not 
answer questions about the .social value of expenditiire or the dis- 
tribujfc^on of benefits • . 16 

Calculations attempted to provide an estimate of costs in' the low 

to moderate range, on a monthly basis ^ • . I'i^ 

VJith the previous limited level of usage, costs per student session 
on the terminal are considerably more than the hypothetical use of 
Individual tutors Would be • . . 21 

However, with the anticipated prograin expansion for winter quarter, 
costs per student session for 'the CAI terminals are roughly equiva- 
lent to the hypothetical irutorial model, with possible further 
cost reductions if student usage were increased 21 

■■• 

Six recommendations for. CAI operation resulting from this study 
are as follow's: (l) set up a clear maintenance agreement; (2) ex- 
pand usage of present terminals by increasing the numbers of student 
and faculty users; (3) conduct a feasibility study installation of 
university-owned computer line; (U) relocali^ the library's tele- 
type terminal to allow its use for CAI; (U) continue efforts to 
siinpii^^fy operations for students, faculty, and library staff; and' 
C6) set up a simple monitoring system to give information about 
costs and usage of the system » 27 
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II. FOREWORD 
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Computer assisted instruction (C^l) ^i^s begun at the Merrill 
Libr.aiy at Utah State University in the summer of 1972 >n.th several 
purposes in mind. CAI re;presented a new direction in instructional 
media which offered considerable promise in individualizing student 
learning and in maximizing the time and'^'e^^rts of teachers. The •^^ 
promise of the system was such that this type of instruction was judged 
tod important to ignore. Rather than invest heavily in CAI, however, 
an attempt ^s m^de to try the system at a low level before expanding. 
First one terminally and later two more were purchased. 

This report examines the present level of operation ^ first from 
the viewpoint of those familiar with CAI operation arid then^ from 
the standpoint of efficiency,, through cost-benefit analysis. Apprecia- 
tion is expressed to all tho^e who responded to interviews or who took 
time to pro,vide needed data for this report. The conclusions* tad 
recommendations are those of the author, ^nd he assumes full/responsi- 
bility for their accuracy. It is hoped that this report can be of 
use to those connected with the program in deciding upon direction 
and level qf operation for the future.' 



J. N. Eastmond, Jr, 
December 23, 197^ 
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III. DESCRIPTIOiy'OF COMPUTER ASSISTED INSTRUCTION OPERATIONS 

Using the computer for computational, assistance as not n<ev at 
Utah State University. The computer science depart^nent, various 
engineering departments , arid otl^e?^ , have been using the computer for 
years to spe'ed calcul^ions and to allow f6r the solution of complex 
problems'. HoweYer, the idea of using the computer as a substitute 
instructor (or tester) is somewhat r^ewer, and it^ applications — ® 
in conjunction with programmed'^ ins t^ct ion , individualized, and 
self-paced learning models — are still being explored. 

Arguments gor CAI ^ 

Education has been criticized by. some observers (e.g. Machlup, 
1970) as being locked into a "labor intensive" mode of operation . 

Jf * - 

requiring large numbers of highly skilled teachers. One. proposed 
means of increasing efficiency has been to substitute capital for 
labor; for examp^lV, use a Computer terminal or media to increase a 
teacher's ability to instruct, and thereby provide the same or f 
improved learning for less cost. 'Aside from the economic arguments, 
advocates of- CAI have cited the advantages to be obtained- from 
self pacing of instruction from the immediate feedback an-d motivational 

• aspects of the computer. In Some schools (e.'g. the Air Force Academy 
or Brigham Young University) extensive use is made of CAI, to include, 

<^entire courses structured around the ^computer . The ' quotation from 
ICenneth Boulding is illustrative of the promise many see from the 
application of computer technology: • ' ■>■ 



■ . -1- 

/ 



The computer is an extension of the hufliaxi mind in the vay 
that a tool or even an automobile i§" an^^extension-^of the 
human* body. The automobile left practicairy ho human insti- 
tutiofl* unchanged as a result of the increase in human mobility 
which it permitted. The impact of the computer is likely 
tobe Just as great, and indeed the whole world of electronic 
media this represents . . » an extension of the human nervous 
system and what is perhaps even more important, a linkage 
of oipr different nei^vous systems. ^ (Boulding, I968, p. 209). 



The Terminals In MLLRP , ■ > , • ^ 

if ( 

The acquisition of three computer terminals for. the Merrill Library 

c ( ' ■ - 

and Learning Resources Program (MLLRP) began the CAT program. The 
first CRT terminal was purchased in May, 1972, with funds froBi the 
Instructional DeveiTopment operating budget, and two additional terminals 
were acquired later that winter made possible by an allocation fro^n 
the Provost *s office. . - ^ ^ ^ 

The terminals. Beehive Models No, III-A, were purchased from 



Beehive Medical Electronics Inc.,, Salt Lake City, Utah. Each oA^they^ 

three terminals closely resemble a television screen with a typewrj-ter 

keyboard attached. CRT (Cathode Ray Tube) Terminals such -ag these ha^e 

the advantages of speed of presentation and good readability.'. The 

disadvantage, however, is t^at the message erases completely and 

instantaneously, le-aving no "hard pDpy" as a teletypjf terminal would 

* « 

produce. In order for the student to keep a copy of the material, \ 
he has to make written notes. The library does own one teletype 
terminal but has used it mainly for bibliographic searches and .assorted 

{ 

library usea, rather than for CAI or CAT.* . 



*An explanatiOT of computer terminology ^used in this report is 
found in the Glossary on page 29* 
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The-, coniputer terminals were intended to augment the various 

. ' i ' 

media and lesirning modes then"^ available in the library. The ternjinall^s-^ 

■<J» . ' - 

were placed in the Au^io Visual area of the library, where their 

ODeration. could be monitored by library perspnnel. . While it was recog- 

nized that three terminals did not represent a major commitment to 

■ this mode of . instruction, it was hoped that: (l)' faculty members / 

from various departments could use these centrally located* and acces- 

» / 
*• * 

sible terminals for purposes that^ would complement their own courses; 

« ' - 

(2) programs and expertise with CAI could.be developed on campus j 

/ . • - . 

and i'i) Utah State University would not be completely^ ignoring a -field 

xhicH appeared to have considerable promise fdr future growth. 
CAI Vg/ CAT * r 

' * During the two years of operation in MLLRP, the mos.t frequent 
use of the computer terminals has been for computer-assisted .testing 
(cat).-, students come to the library at their own convenience t© take 
requoSr^d quizzes for a class. The computer asks them multiple choice 
questions covering material they have sttidied, they enter their 
Answers, and the, computer tells them if their -response wsts correct or^ 
incorrect as well as supplying t^ correct response. In addition, 
'the computer records their answer and, at- the option of the instructor, 
givesah item analysis or scores of groups of items demonstrating a 
particular^skill to the instructor. By including -several alternative 
forms of the test, the student who fails^to obtain a passing grade 
'^can retake "bhe exam at a later ^tinlfe after restudying the material. 

Some limited use of comp.uter assisted instruction (CAl) ha$ been 
madfe On these terminals, particular ly'^during the fall quarter of 197^. 
In this mode of operation j the student is give^- instruction similar ^ . 
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to that encoiinteri 
✓ ' 



) 

ed in 



a programmed text.- He is aaked ^ceptain questions 
d^ealing -w^th the material presented and must enter his answers, to which 
he' is given imme&iate .^confirmation br correlation. Computer assisted 
testing represents an abbreviated form of CAI , where t)nly the questioning 
mode Is used. . - 



. Operational Difficulties ^ ' ' ^ / 

.Following initial installation" of the computer terminaJL, problems 
with eqluipment breakdowns were much more .frequent than had Ipeen antici-' ' 
pated. A number of reasons for these breakdowns has been Suggested ,^ 
and these will be examined more completely, ip the Results section bilow.. 
At this point* it should.be noted that mechanical difficulties w^re meiny 
and varied; that the ^process of* ' debugging" has gradually improved v 
the 'reliability of the operation; but that operation of ■ the system 

3jas ^not beea smdoth and i:outine. Considerable effort has gon^ into 
aking the operation both ysimple and reliable, and at, the present time^^ 
the terminals are 'reported to be relatively .trouble-free . * Within the 
■past two months, the terminals have been moved to a different section 
'of 'the library — on^hf^fourth floor with the microfilm^ microfo^Tn,. 
and microfiche readers. , 

The present provision for^^service is not under a service 'agreement . 
When a terminal malfunctions , a call is placed to the computer center 

■ ; . ■ ^ ■ 

where a programmer/specialist traces down the problem. If the. problem' » 
; involves the program or the main computer, this specialist csyi handle' 
^ it. If the problem traceC^o the telephone line connecti»ng. terminal, 
and computer, the Bell Telephone Company repairman is called in. 
Finally, if the terminal itself is defective, a repairman must be j 
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called -up froh^^Salt Lake City^ or the equipment must be taken to the^ ^ , 
Salt Lake City office for repair. Real difficulty can result when^the 
exact location o^ the malfunction is not appa!r^ntj because eadh party 
•^involved can 'maintain that his portion 'of the system is not -responsible 
for the bireakdown. The shared ;responsibility fyr mainteri^ce plus 
the obvious complexity of the system tend to increase the amount -^-of time 

. , ... • . - * '^-^^ 

that the ' systep ip down," i.e. inoperable.' . 



o 
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Financial Arrangements - • , ^ • . 

As^mentioned above^, the initial outlay; , for the termihals was made 
with the original purchase. The cost of the operational costs is Shared 
as follows: 

1) . The cost of the computer lin^ and monthly equipment cost are shared 

equally by the/MLLRP ,and the ''Exceptional Child Center. 

2) The telephone line cost is paid by^ the MLLRP. 

3) The MLLRP pays for the staff- tJme to monitor CAI operations. 

h) ^ ^ "The cost of programmer time to set up the initial program is paid 

b^the department' or instructor involved, 
5*) .The cost of maintenance^ which fluctuates considerably, is shared 
"between the parties involved. 



Attraction To Faculty Members 



be 



of 



The present system was designed to encourage po^isntial users to 
:ome involved with CAI. The purchalse price of the terminals has 



be(?n covered, and the operating^^trdge of MLLRP defrays the major portion 



the monthly expense. 

i ' . 
Personnel to monitor* the operations, as well as an eyt^n'ded day 



of service, offer potetitial^advantage^ for users. Cos^b«a^or^e user 

' 12 



are mainly deveioiiiiiental\ although sonje mont-h-to-month operational expense 



xs 



involved. Reactions of potential- users t6 the -system j.s reported 



in the "Findings" section below. • - 
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IV. PROCEDURES OF THE STUDY , 



This study was requested in e'arly October vith the expressed • ^' 

purpose of' clarifying decision alternatives concerning CAI in the . 

Merrill Library. The scope was puirposely limited tii5ie and resources 

to allow q\xick 'turnaround of information, " 

^ ' V^' ' ^ . . . ^ , / ' . \ 

Research Questions - ^ ^ . 

A 3et of research questions pro5)osed for the study is given in 

A;ppendix A. ^Questions were gene:^lally descriptive in nature, the following 

being^*the main questic^ns.: 

1) .To what extent is the CAI system in use at present? 

2) What factors have encouraged or hindered CAI usage? 

3) How. do people feel a.bout .the system? 

U) What alternative approaches are available ajid how feasible 
are these*? ' . , ^ 



The Questionnaire ^ / ' 

To obtain answers to these questions a series of four questionnaires 
was used to poll>^tudents , library si^aff, faculty users ,» and prospective 
users. Following a brief pilot testing, students- and- prospective 
faculty users' were polled with a telephone interview, while for library 
staff andvpresent faculty users a structured interview was used. The 

- \ 

standard queistions ^sked each group are given in Appendix. B. Additional 
questions were asked the interviewer felt that useful information 
could be obtained. 



f The nimbers of persqns intierviewed were ji^irposely kept small: 

♦ '*,•'' 

stu&ents — four; library staff — six; potential faculty users — four; and / 
present faculty users— four. To the"^ eighteen people who were forma^^Ly 
interviewed must be added at le^st four additional peo,ple who were / 
helpful in su^^lying data or ideas f-or the study. • ' , ^ ^ . 

Faculty and staff to be interviex-zed were selected on the l^sis of' 



ations^ ^ 



faiiftM|Lrity or .interest in the CAI operations^ §fe recommended /by «Dr. 
Douglas Alder;, Associate Director of the Instructional DeveljOpment 
Division of the MLLRP and Dr.- Max Peterson, Associate 'Direqtor of 

^ ^ - K 

the MLLRP. Students were chosen from the" 'ddss 'roster of iDr. Robert 
Me Cham t'aught sj)ring quarte.r. - k . - ^ ^ ^* ' ^ > 



Data Distillaftion 



No attempt^/^b^made to use statistical procedure^ to aneilyze the ^ 

/ ■ 

data obtained in pe^irt^ because of the small number of ^/persons interviewed 
and in part because of the research que^stions examijied. Rather, ^(le 
results have been reported as closgly to the wording and ■ intent of ■'the 
origin""?.! person interviewed. Where a useful observatioji or suggestion 
coTold be gleaned for the rcpg)rt, this has been done. It is recognized 
that these results' have passed through the filter of one observer's 
interpretation aaid as such are not objectified in the sense that some 
inquiries could bor* 

Cost-Benefit Data , " 

Cost data have been extracted from records of expenditures wher- 
ever possible. In many cases, however, where an estimate has been * 
necessary, this has been done using the best informed judgment available. 
Projections of winter course loads were m^de by contacting the instructors 



invblved. The ratr^ale .for determining costs, and estimating benefits 
is giy^ in Appendix C of this repoi&t . 
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V. RESULTS , 1 



Perhaps the. best place to begin in reporting results is by recom- 
mending that the reader turn to Appendix B and read some of the responses 
^given. Some real insight into the system's operation ^from the^ point of 
view of stu^nts and staff, potential , users and present users^can be 
gained. c ' • * ' " . ' - 

"This section attempts to synthesize the data reported there; to 
condense the findings rel&ting to the major inv"estigi.ted questions. 

Feelings About The System " ^ ^ ' ■ • 

Expressions of feeling toward the CAI- system are generally positive, 

with skepticism and some Yairly strong negative feelings expressed by 

some persons. . ^ \ . . 

Student res:^Qnse was overwhelmingly ^osiiiv^ after the initial 

hesitation' that was reported in learning to work a new machine^ 

Although 'all but one had experienced some frustration when the machine 
.'was out of. order, all (Sf these students— in remembering their premo'u^ 



experience, rouglily six mont'^is^r^viously — expressed good feelings 



0 ■ 



about the system. - > 

\J 

\ ^ Present faculty users were somewhat more ayare than potential 

• * ti " ^ . 

faculty ""users of difficulties which ''can occur, and thus :^ere somewhat 
more ireserved in answering the question o'f whether they would "recom- 
mend the. system to a colleague. Responses were affirmative, but only 
if the 'colleagufe was judged sufficiently flexible to handle difficulties 
which could arise. All but^one user indicated that a back-up system — 



e.g. a paper and pencil quiz — ^.c^ld be made available if the computer 
were inoperable, ' . , 

Feelings' among library staff 'toward the CM operation were mixed, 
Of the six people interviewed, three expressed strongly negative 
feelings about the syj^tem^ one strongly positrive, and two somewhat^^-j^ 
ambivalent, expressing both posit^.ve and negative feelings. The 
recent move of the ^terminals to the fourth floor of the library has 
reduced thii^^^^tential source of'corvflict to a large extent. 



0 ^ - . 

Present Level Of Usfige • . < . 

Within th^i^st three mon-fehs , there has-been a rising level of""iife^e 
of the MLLRP terminals. Prior to that time , -the testing program of 
Dr. Robert Meqham of the Business Administration Department was 
virtually the only program in "operation/ In a 'class of roughly 
50 students, eight quizzes taken at the MLLRP terminal were required « 
during the quarter. Assuming that each student took each quiz one anci 
Ofie-half times, since one retake was allowed with no penalty to the 
student, roughly six hundred tests t;ere taken each quarter. For 
most of the quarters since the installation-*of the terminals. Dr. 
Mecham's program was the -only program being used. 

Recently, hov/ever. Dr. Rex Hur3t, Head of the Computer. Science ' ^ ; 
Department, has arranget^^^r two programs in a statistics class and 
has several other options which he is in the process of putting into 
operation. , Mr. Robert Woolley^of the library staff has brought a 
number of programs into operation and has plans to use tlfem with . 

o 

classes winter quarte^. Additional ^ faculty members are anticipating 
beginning winter quarter. 
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* A strong possibility ejcists that a second section of the business 
administration course vill be taught using the CAI quizzfes as^a portion ^ 
of the class. Others on campus have expressed ^terest iji* using the 
computer terminal' for CAI purposes. To wha/^ extent faculty members 
T-xill be able to implement these programs .i-xill depend to some extent f 
on the ability of the terminar operation to h^dleAncreased numbers of - 
users. The evidence is that, up to this time, the terminals have ^ 
been underutilized, but that the t^end is toward more full usage. 

/ ■ ' ■ ■ ; • 

Factors Encourag^in^ CAI Use * « . • - 

Majiy of the factors cited in th^ interviews as advantages of 
computer .assisted instruction or testing have been cited already. 
The provision for students* self-pacing for immediate feedback, and 
for accessibility during extended hours of the day were seen as ad- 
vantages for students. For teacl^rs > the system was seen to offer a 

I " 

usefiol way of eliminating routine* tasks for the teacher himself 
or for his assistant ( s ) . The novelty of the approach was seen as an 
advantage to both students and faculty as it helped to motivate students 
and. expedite learning. Library personrlel saw the system as a usefTiT'" 
addition to the library's resources, with at least theoretical *(|)r po- 
tential value, although in some cases demanding more time than the 

^ ■ . i 

monitors co\ild afford to give. . 

Factors Discouraging CAI Use * . * 

The ^ comment of one faculty user serve's to highlight the^i^a^or 
disincentive to the system. After experienciij^«.&onsiderable iCustration 
due to mechanical failure and finally removing his program from use^, 
this person could say, ''^l^Oien the bugs get worked out of the system, 
I want to know about it so our program can go back into operation." 

ERIC > IS 



All persons interviewed were alike in wanting to see the ^system work 
smoothly • While it is acknoirledged that major improvements have been 
made iji the system'^s reliability, there is no doubt that the f>requent 

" ^ " ■ ' / - ■ 

mechanical failures have been the .greatest /lisince^ive to CAI use Ir). 

MLLBP over the past two and one-half years. 

* * * 

Additional disadvantages cited were (l) scheduling problems at 

peak periods in the quarter — often aggravated by -mechanical problems 

d^l^i'ng these times; (2) cost factors which would i]^ak^ the' system^ - ^> 

costly in comparison with other means, e.g. t^^st correction by hand;"^ 

(3) the problem of students having to leave their department "and go to 

I - ^ ' . , 

the library to use the terminal; (i|)»lack of instructor familiarity -with 

complex computer procedures^ necessary to set up programs; and (5) lack 

of simple, specific instructions ^^^^'^udents and monitoring staff. 

Alternative Approaches 

Many of the proposed improvements offered by those interviewed 
follow logically from the disadvantetges listed above. Typical suggestions 
included: 

1) Upgrade the mechanical reliability of the isy stem to where mal- 
fxinctions are the exception rather than c^ummonpl^ce . , 

2) Use a service agreement; if not from the equipment supplier, then 
from a local el^tronics technician, so that there is an incentive. 

o to maintain trouble-free service. , " • 

^3) Make student instructions breathtakingly simple. 
h) Following a student response ^to a question, allow more time for« 
the question to fade (or put under the student's control) "so that 
the question and alternatives may be re-read thoroughly. 

c 
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5) "^toProvidfe a training ct)urse and a simple- operations manual to anyone 

who will be expected monitor the system, * ^ 

" • ■ ' ' " . ' » ■ - 

1^ . 6) Simplify the process pf bringing, the system into operation. 

7) Move the terminals out' of the li'brary and into the various-depart- 

ments* . ^ 1 > «• 

- 8) Offer a workshop to prospective faculty users .to explain the process 

'^'^ ' of getting a'progfam operiational. • f . 

A . . • . , ^ ' • 

9) Have a simple manual for faculty users .to cite/programs which' 

* { • * w ft? , 

are' currently available in vaMous''' fields » * . ^ • 

/ % " / ' . ' ' . ' ' ■ 

10) Iil.ci'ease' the number oj^ teriijinals . . * «^ . ^ 

^ ; Sojne additional suggestions , some very ingenious do not follow . 
% ^ directly from\tated deficiencies, but may offfer considfeij(a^.(5 promise: 

1) * Purchase a "multiplexer" unit to improve the system's speedy Theg^-^ 

present polling system is not instantaneous and does require 
additional student time waiting. 'Estimated cost for this unit^^^^ 
about $jl,00d, but it would serve terminals other tharfiJ^LRP's 
and cut monthly equipment costs. 

2) Put some central campus agency- in charge of th@ proliferation of 
/ CAI terminals to coordinate and maximize their use.' 

3) Obtain a teletype terminal with "hard copy" capability, 
k) With the assistance of the Engineering Department, put in a 

computer line front the MLLRP terminal to the computer. For MLLRP, 
the conduit already exists, and the saving each month ($91.90 
for line and equipment) wpoold be substantial. 

5) Use present administr/ative terminals on a shared time basis for 

N • ' 

instruction as well. 
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Other suggestions were giver^(See Appendix B), but those cited 
above were judged most worthy of con*sideration at this time.. This 
particular phase of tl^ - interview, eliciting suggestions for imprWe- 
ments, was extremely valuable in enlarging the range of possible f ^ 
SQlutic^s to present prob^em^, *• - ■ \ 
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^ Yl.^A COST-BENEFIT ANALYSIS OF MLLRP TERMINALS 

Cost-benefitj axiaiysis has beer^i' described by*W|irner (I9T0) as a 

^ ''" ' • ' V . 

substit.ute for the pressures of the ^marketplace- iVa public institutional 

<; ^ . ^ 

setting. Cost-benefit offers a rational approach to majcimizing return ' 

(benefit) based upon efficiency of spending (cost). 

0 ■ ^ . 

Limitat^ions Of Cost-Benefit - ^ 

In prefacing a cost-benefit analysis, it^ is important to emphasize 
"^ome limitations of such a study. Any calculation of costs must 
necessarily involve some assumptions and estimations • There are a number 
of fprmulas which may be used, as well as alternative bases for comparison. 
For example, a CAI program could be compajred with other modes of in- 
struction such as classroom lectures, slide-tape presentations, or typical 
quiz sections. ' Ano^ier comparison is across program options ^^for the 
CAI — e.g. exj^insion, modification, phasing out, etc. Portions of both 
approached are attempted herein. 

The important thing to emphasize ^ith any cost-benefit analysis, 

/ ^ 
however closely ti^d to actual data, is that the measure is only one of 

efficiency . Numerous other* facers must be considered in making any 

decision, such as the distribution of benefit to ce^rtain segments of 

the campus population, the feelings of people involved, and the social 

value of the project. Thus, it is possible for practitioners in the 



study of cost-benefit — e.g. Barsby (1972) and Eastmond (196T) — to make 
recommendations considerably different from those whilh the cost-benefit 
model alone would suggest/" 
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This analysis im^olves the actual monthly costs or the best 'available 

4 estimates which could be obtained. An explanation of each cost computa- 

tion, actual or estimated, J. s included in Appendix C. Est:^iates 

costs are generally in J:he average or low range, simply to allow c6n-# 

. *^ ; 

elusions tljlf the item costs a!fe^ least this much, Estima'tes of-beaefit . 
have generally 'been average to favorable. ^ , * . - 

\ 

Assumptions , * . . 

Certain assumptions are necessary in beginning any cost-benefit 
analysis. The present ones are. as follows: . 

1) Computer-Assisted Instruction (CAl),^and Computer Asslste'd Testing 
(cat) are not distingi^ished in the calculations. 

2) '^The C.A.T. program of Dr. '^Robert Mecham, which was virtually the - 

only program in use for most of. the two and one-h^-lf years of 
operation of the terminal, is ^used as the cost-b§hefit baseline. 

3) The CAI terminal could be compared with several different models 

of learning. Howe^r, with the immediate feedback and individualized 
pace, it appears to fit closest to the tutoring model, and costs ^ 
are calculated with this comparison in mind. 
U) Calculation on a monthly basis (rather than quarterly or annually) 
is assumed to handle the periodic fluctuations anticipated in the 
system. ' , 

Computation Of Costs , <^ 

A detai-l^d computation of costs is given in Tables 1 through 3$ 
apportioningvg^sts between MLLRP and the Business 'Administration Depart- 
ment. Because of the basis for estimates used, while costs' could be 
found to run somewhat , fiigher , it is doubtful that they are any less than 
the total figure oshown. fhe total cost is competed at slightly over 



Y^jJ^^ eigKt" hundred dollars ^$802.8l) per. month.- crp^ 



hmimiirnrrT-uaaia 



r 



TABLE I 



A Calculation of CAI Cosi>s To "mLLRP ' / 

Note; An explanation of the basis for each figure is given oin Appen(9.ix C. 



i Mont^ily 

I. Fixed Cost 

A. Initial Expense For^' Terminals $7,582 

1. Depreciated over 5 years 

at 652 interest $lU6.9U 

2. Opportunifby cost; interest 
.^ foregone at 6^ single inter- 

' est 39-00 

B. Program Development ' ^ 

'l. Cost of mini grant ($30a) 
depreciated ovi^ 5 years 
^ at 6^ ' 5.80 

2. Opportunity cost: interest 
f oregoiE at 6^ simple inter- 
est . . . \ 1.50 

. C. Cost of Floor Space (Estimated)* . . . 25.00 

Total Fixed Cost To MLLRP ........ 



$2l8.2U 




II. Variable Cost 



A*. Telephone Line CoBt 
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Mont];ily equipment cost 
(shared 50-50 with Exceptional 
Child Center) 



2. Computer line (shared 50^-50) 
with Exceptional Child Center) 

3. Restricted telephone line .... 

B. Maintenance Cost On Hardware, under 
hypothetical service contract , estimate 
based upon $20/month per iinit * . ♦ . 

C. Personnel Cost (administration cost ' 
plus .one-fifth time of person 
monitoring) 



$ 3i+.i+0 

57. 5q 
2.50 

60.00 

300.00 



^ * ■ Variable ^ Cost To MLLRP » . 
TOTAL, All Costs To MLLRP per month 



$672. 6U 



~1 
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TABLE 2 



A Calculation of Monthly CAI Costs To The 
Business Administration Bepartment 



I. Fixed Cost^ 

A. Program- Development Costs ^ 
(estimated $2,000 depreciated over ' ' 

5 ears at 6% interest $38.67 

' / f ' 

B. Opportunity Cost: interest . ^ 
foregone at 6% simple interest ... 10.00 

C. Instructor Time Cost in • 
program development, assumed 
eq^urValent to alternative 
quiz [procedure and not 

calc\|lated v . O.gO 

Total Fixed Cost $^8,6? 



II. Variable Cost - * ^ 

A. Monthly Charge for Computer Use 

1. " Da.ta Storage (estimated) . » . . $15-00 - 

2. Computer time* in use*. . ^ 
(estimated) 26.50 

B. Computer Specialist To • 

Troubleshoot "... * ^0.00 

Total Variable Cost ........ $8l,50 

GRAND TOTAL, All Cost? To Business 

Administration Department per month » ' $130.17 



*NOTE: I A new billing system through the computer center , allowing 
^y run of less than 5 seconds to be tilled to a central 
account, will shift this expense from the Business Department. 
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TABLE 3 



Summary of Calculated Monthly Costs of The CAI Program To 
MLLRP And The^ Business Administration Department 



Fixed Cost 

A. To MLLBP $218. 2U 

B. To Busines^s Administration hQ.6^ 

f 

. ' Total Fixed Cost $266.91 



Vaf^able Cost " 



A. .To MLLRP $U5U\U0 

B. To Business Administration 8l . $0 

Total Variable Cost . $$3$ -90 

GRAND total; All Costs per month . . . ■ • ^02 



/ 
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Computation Of Benefits % 

. Bene^^its^^e figured as the number of student sessions >ri.th the 
com\puter^ during a month's time. Dr. Me cham ' s class typically has an ^ 
enrollment qt 50 students who talte a total of eight quizzes at the CAT 
'terminal during the quarter. Students are allowf^d to take the quiz * ^ 
a second time without penalty and many of them* do so. Assuming that 
each student taltes every other quiz twice, a total of ^00 sessions per 
\uarter or 200 per month ife thus^obtained. " . * 

iT 

Cost-Benefit Calculation For Previous Operational Level 

» j>' 

• A calculation of coat-benefit would show: * * *^ • 

Costs ^ $802.8l/month . *] / 

Benefits ~ 200 student sessions/month " 01/student . . 

session 

At the present time, this cost- is Mp5rtioned at approximately 
8U percent 'to MLLRP and l6 percent to Business Administration. Olearly, 
this program is expensive at the present level oi operation. 

A comparison with a hypothetical tutorial, model is useful at this 
point. It is assumed that student tutors could be hired at $3 per hour 
and used to tutor three students per houx*. If additional costs of 

0 

$1."50 per hour could be assumed to cover (a) administrative overhead; 
(b) salary fringe benefits; and (c) office or classroom space, the total 
cost per hour of tutoring would be $U.50. A cost-benefit ratio would ) 
• show a cost of $1.50 per student session. At the low level of CAI 
operation, the CAI model is about two and one-half times as expensive^ 
as the tutorial model, ^ - ^ 

Cost-Beiigfit For Projected Expansion Winter Quarter 

However, if number of students served by the CAI operation is 

^ expanded, as projected, the unit costs in the program drop. As was 
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mentioned earlier, this expafision has begion to take place during 
fall quarter of this year. For Vinter quarter, a total of five 
additional classes are expected to use the CAI terminals. The estimated 
number df student sessions for winter quarter is calculated as follows: 




'TABLE h 

Estimated Student Sessions For Winter Quarter 



■ \ 



' " " Program C „ 


No. of 
Students 


No. -of 

Sessions 


Repeat 
Factor 


A: Previous Program 


50 


8 


1.5 


■ B 


150 


7 


1.0 


C 


70 


• 5 


' .1-0 


< 

D 


25 


5 


1.2 


E 


12 


« 2 


1.0^ 



'Quarter Total, Student Sessions 
Monthly Total, Student Session's 



Total 
Student 
Ses^ifons 




This expansion is a major one, more than tripling the previous 
level of usage. "For the most part, this is being 'done with pre-existing 
programs, or modifications of these. No attempt is made here to cal- 
culate the increase in fi^Xed costs, in each cas.e an investment in' k 
computer program, debugging it, etc^. However, variable costs will, rise, 
as estimated below: 



TABLE 5 

Anticipated Increase Ifi Monthly Variable Costs 
Due To Expanded Usage 



Aduitionatl Peijsonnel Cost (increased from one-fifth 
to two-fifths time, plus administrative costs) 



/ 

$300 
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(Table 5, Con1i.'d) 

■/^ . ' : 

Additional Computer Data Storage (at tince present level) $ 30 

Additional Computer Time In Use (at $10/month/program) " UO 

Additional Computer Specialist Time To Troubleshobt 
(at tTxice present level) 



Total Additional Variable Cost Per Month , $UlO 

The major increase in expense is anticipated to be in personnel 

"1 ^ * ' 

time involved in monitoring the oper^ation. At least three times as 

. 

many new st^ents will need to be orien'^ed to the operation. Scheduling 

\f±ll likely be essential to accommodate aJ.1 students. In short, at ^ . 

least an additional one-fifth of the staff monitor's time \r±li likely 

be needed. ^ 

The calculation of a cost-beiiefit ratio for sua expanded program is 
as follows: * | 

'^t _ Previous Total Cost + Additional Variable Cost ^ 1212.81 _ $1.67/ ^ 



enefit * ' Increased Student Sessions 725 student 

session 

This ratio approximates much more closely the cost for the tutorial model 
($1.50 per session). Further expansion^ could likely bring the CAT 
operation into a position of relative advantage over .the tutorial model. 
However, the feasibility of such expansion with existing -equipmerjt has ^ 
yet to be demonstrated. ' ' t;^^ . 



*Dr, Mecham has indicated possible interest of a colleague, in 
Business Administration in possibly using the same quiz prograrti^ 
Other interested potential users vrere noted in the interviews. 
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Capacity Of Existing System 

A question ougltt to be raised as to the maximum capacity of^the 
existing ^system, and whether the Iproposed e:cpansion vill»push it to its 
limits. Assuming an average time of thirty minutes per student ses^ion^ 
inclurllng explanation time, familiarization, "breaks bet'tfeen users, etc- 



each terminal could handle two students per hour, a total •^oT nine 

students per hour. Thi^is a fairly generous time allotment, as many 

.' - ' ' 

sessrons take considerably' less than twenty minutes. 

, *.* 
With terminals accessible 300 hours per toonth, a inaximum of I8OO student 

sessions per month .i^^^po^ible in theory. The, proposed expansion in 

usQ,ge would utilize 725 student sessions per month. The program would 

<? 

then be utilizing well under fifty percent of the system's capacity 
(about ho percent). 

While it may be necessary to set up a formal scheduling system and 
a system of pacing in- assignments to prevent end-of-the-quarter overload 
winter quarter will not be near the system's capacity. Thus, arguments 
to bring in additionail computer terminals vui^d seem to be premature at 
this time, particularly in view of the need to demonstrate that cost- 
efficiency similar to the tutorial model can be attained, 

C 

Conclusions 

In conclusion, it can be sefen that the CAI system has been under^ 
utilized up to the present time. Costs per, student session ihave been 
relatively high for the CAI terminals up to this point, over per 
"session, due to the relatively small number of students served. 
Given the experimental nature of the program ^ as the pilots project for 
possible ^^greater utilization, as well as the exposure demonstrated 
favorable and experience with computer applications given to both 



, ^5 

I 

faculty and students, the expenditure can probably be justified. "This 

* ^ 

cost, however, is estimated at more than txrtce that of a comparable 

tutorial program. However, if the operatig^ff'^fS^xpanded as anticipated 

for winter quarter, it is estimated that costs ^ri-l-l be more nearly 

comparable to the tutorial comparison model, but still somewhat higher,. 

The key to malcing the CAI terminals cost efficient at this time 

is seen to be increasing the numbers/of faculty members and"* students 

using the facility • Givjsn additional expansion, it is anticipated that 

■ * ^ 

the CAI system could be made to operate more- efficiently than the tutorial, 



system. However, such efficiency; has yet to be detAonstrated^ Given 

the estimation that the expanded CAI use would still utilize the terminals 
i ' 

for about ^0 percent of the available time, two conclusicMas can be drara. 

First, there is considerable room for expansion in the numbers of 
students and faculty served at this time. Second, any -attempts to increase 
the number of terminals through new acqiiisitions would seem to be pre- 
mature at this time. 

The question of - what the minimum cost per session could be, using 
the present teitoinals is difficult to estimate. Certain economies 
may be affected", expansion of progrftms aiid number.s of students served 
may be maximized, but only with an :i^G^ease in variable costs such^as 
monitoring personnel costs, comput^ expenses, and maintenance. At 
some point , given the cost constraints described above, cost reduction 
reaches a limit. For the present system, thatf limit appears to fall 
between $,75 and $1 if half-hour sessions for each student are scheduj.ed 
and between $.50 and $.75 if twenty minute majcimum sessions- are scheduled 
(with costs shared by MLLRP, the computer center, a^d various depart- 
ments). Such calculations become extremely tenous, being merely 
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extrapo^Lati^ns of present data; but 'they do estimate some theoretical 

\ ' 
limits to efficiency of operation of the present system* 

It has iDeen suggested in one of the interviews that CAI may see 

tije kind of coat reduction that has happened with electronic ^Calculators 

ift recent years .\ If so, it \-n,ll l)e a new generation of CAI terminal^ 



ye£ 

^and programs whic\h Trill bring this about. At the present time, CAI 
operation must geA^erally be justified on gro>^ds othisr than cost ef- 
ficiency alone. 
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VII. RECOMMENDATIONS 

y " A 

Based upon the intef"^^?lev?5 vith present aVd potential faculty 

^\ - " 

users, libraxy s'^aff, and students who are acquainted with the- Computer 

Assisted Instructft^ program at the Merrill Libraly and Learning Resources 

.Program ►(MLLRP), the^ollowing major recommenddticyi§ are offered: 

r) Set Up A Clear Maintenance Agreement and, definite responsibilities 

to keep down time mini-mal fbr the termitnals* If a local techni- 

cian can be found' and service can be' set-up on a monthly basis, 

with parts and labor provided as necessary, this would seem to be 

the most economical approach. Reliability for this system is a 

. »* must. . ' 

2) Expand Usage Of E^j.sting Terminals > There is evidence that ^a ^ 
number of potential faculty users of the CAI terminals are avail- 
able and that the umber scheduled for winter quarter will greatly 
decrease the cost per student of operation to a 'level comparable 
but slightly above that of a tutorial • model. Considerable 

■ enthusiasm for this approach on the part of faculty and students 

<* . <. . ■ 

would seem to justify an attempt to expand usage* If all @>o^s 
well,^!t~^an likely be expanded to a fairly favorable cost- * 
efficient position. 

3) Conduct^ A Feasibility Study to see if the fairly substantial line, 
and equipment costs paid to the telephone company can feasibly 
and legally" be reduced by having a 'line located in existii 
conduits. ,^ 
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h) Relocate The Library Tele^yT>e Terminsil to the' CAI area to allow 
for its use ^or instruction as we]4. as its present use» in T^iblio- 
graphic .seaYches 5 etc. While aome provisions for soundproofing 
may be required, there appears to be enough^ interest in a hard 
copy system to justify" making this available for ^both CAI and 
library use. • • ^ 

5) Continue Efforts' To Simplify Operations , from the a'^andpoint of 

faculty and student u&ers , as well as from monitoring library 

■ ^- • 

) ^, \sta;ff. For students, this could be a one-page, step-by-step set 

► of instructions. For library monitoring staff, a brief booklet 
of instructions on what procedures to follow for troublesome 
situations would be helpful. For faculty members , a booklet on 
how to §elect an existing program, how to obtain assistgnee , etc., 

Q could be helpful to them and useful in encoiLrB;ging others ,to avail 
» themselves of the service.^ In any ^s^Q^e^ simplicity is crucial. 

(f) F^fyt Up A Simple Mpnitoring^^S^stem , givin-g a record of costs and 
usage of the terminals, which- could be examined at r>eriodic in- 

t " 

tervals (e.g.* every quarter) to compute the relative efficiency 
of the system. 

In conclusion*, the SAI system appears to have considerable support 
from users and is in a position — thrpugh anticipated expansion of 
terminal usage--to demonstrate a level of operation that is more cast- 
efficient than has pjreviously been the case. It is recommended that 
this course of action, be followed, but that additional purchases of ' 
complex hardware or more terminal-s be avoided until a more cost-efficient 
level of operation is reached and can be maintained. If such a level 
cannot be attained, it is recommended that a hard look be taken at the 
system to see if dts benefits justify the operational costs. 
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SIJ^LIFIED GLOSSARY FOR CAI 



Some observers have accused the people who woniT^round computers of 
speaking a new language, ^^ile this is an ovierstatement'; certain terms 
B^e often used which may or may not be faniiliar. Here^ is an ei^tempt at 
clarifying. , ' * 



"Bring M-p the system" 
C.A.I. 

/ 

C.A.T. 

"Computer is down" 
C.R.T. 

'"Debugging'* ■ 
"Hard copy" 
Hardware 

"Hot Reader" 

"Log on" 

Multiplex • 

Pdlling 

Printout 

"Software 
Teletype 
Te^rminal 



Putting the terminal into operation through a 
step-by-step procedure. 

Computer-Assisted Instruction. 

Computer-Assisted Testing. 

The computer (or terminal) is out of operation. / 

Cathode^Ray Tube; a particular typ'e of terminal 
where the. message is givep on a screen (similar 
to^T.V. ). . 

Process of correcting errors in a computer p^-ogram* 

Message from the computer given on paper. 

The mechanicaj- parts of t'he system; the»^ computer* , 
line, and terminals. 

Type of terminal where a program (usuaJ-iy small) is 
fed in and gives the printout immediately. 'A "self- 
service" computer. 

» 

Putting the terminal into operation through a step- 
by-step procedure. 

A particular way of combining messages from t^erminals 
in different locations. 



c 



A method of taking the message, from tw6 or more ;ter- 
minals and transmitting it on a single telephone line.^ 

Same as hard copy. Message from the computer given 
on^ paper. 

The computer program, the message, the content. 

Terminal which gives a printout. 

A unit, similar to a ^typewriter , through which 
messages are sent to ajid received from -th^ com- 
puter. 
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RESEARCH QUESTIONS MB SOURCE OF 
DATA FOR COI^UTER-ASSISTED INDUCTION 

Administrative Information * 

1. To what extent is the CAI system in use at present? 

^ a., number of terminals ' ' 

b. number of departments 

c. number of programs available { 

d. number of students affected 

2. What are the costs of the system? 

a. initial outlay 

b. of operation 
c- of maintenance 

d. of operator time <, 

e. to.department 's use 

3. VJliat alternative solution strategies are available? 

Records of Operation and Maintenance 
1. What is the frequency of CAI use? 
2- How. much unanticipated down-time? 
3. How frequently are repairs necessary? 
k. ' \^at maintenance expense is incurred? 



Qucgtipnna ires 
^ 

1. 'what types of learners use these facilities most effectively? 

2. What evidence. is available to support the effectiveness of this systeip? 

3. .V/hat advantages does this system have over other systems? 
U. How do people learn about the osy stem? 

5. V/hat mechanical expertise is required to operate the terminal? 

6. V/ho are the professors and students that avoid this type of instructional 
mode? V/hat are their reasons? 
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A-2 

7. Hov much operator time isr involved in using CAI? 

8. What^ alternative systems axe available? 

9. Hov do users-and non-users (students, faculty and library staff) 
feel ^about the system? 

10. Of students who have used the program, hov much frustration yas 
encountered? 
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APPENDIX B 

Research Data From Interviews Of* Library Staff, 
Students. Present* and Potential Faculty Osers 





PART I: LIBRARY STAFF 



1;' What has been yojur relation to tl>e computer terminal operation, and 
how long have you been involved? 

directing the operation* Tifo years. ^ 

In my division, but riot direct supervision. . One and one ha^Ugyyears. 



Occasional assisting at the computer users at the counter. Since the 



^operations. 



beginning of computer 
Program maintenance and simple troubleshooting. At least one year. 
Recently placed in charge of (^^rations. One to two months, 
Monitor operations at the terminal, terminal operator for two years* 

2. Has your experience thus far been generally favorable' or unfavorable? 
Favorable - 1 • * • 
Unfavorable - 3 

Ambivalent ^ 2 : Program portion all right; but terminal operations 

unfavorable. • • ^ * 

^^See'-many possibilities for u^es, but can also see 
administrative difficulties. ' (^"^^ 

3. Wh^at advantages do yoU^ see with this mode? 
) ^ > 

\ The system has great library possibiMties , particularly as a device , 
to allow the self-motivated student t^pu?^ue studies on his own. 

There is considerable flexibility l^^^^hoV the system is used. It offers 
a ^11 range of media possibilities, with an interactive mode of learning. 

Students enjoy playing with it for the sheer novelty. 

p:t is good for the ambitious student. For^one thing, it offers immediate 
feedback. For 'another, it allows the student t^ retake the test — up 
to three times with the present program. * It is a great sa^er of sec- 
retarial time in giving and scoring the tests. 

. Vr ' . ^ ' ' 

The hours are fJSexible for the student to use the terminal. The cost 
of paper as well as the slow speed of other alternative models msLke 
this system more efficient than a '*h^rd 'copy" system. Also, it is 
^ more reliable. ' ^ 

ik - \ 

An itenl analysis'*^ of questions on the quiz is available to the in- 
structor, mi^low him to see which ones were missed mbst and what 
misconcept^ns exist. 
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In tfeemy, it frees up instructor time. It ^aves him time in 
grading papers. ^ ^ 

A learning program is best in transferring facts'. Material is' 
covered at the learner's o\m rate. A quiz becomes a learning device. 

What disadvantages or problems are you aware of? 

The system is often unreliable. I think it is a form of "window 
dressing" t'o make our programs appear sophisticated by saying that 
^ we have CAI . . yt^ ^ 

• It* seems possiblg_that the system to this point has had inadequate 
funding, supervision, programmijjig, and training. 

The terminal reliability to this point has been questionable. There 
has been a constan-t effort in maintaining the system. 

Because the recbrding of scores *was unreliable^ it was necessary to 
^et up a manriBri^ back-up system which came to be ^ very time consuming 
for staff. V 

Staff members at the terminal have been- unable to diagnose problems 
iZr- directly when they occur; They have had to depend upon the computer 
center for support. There is one key person responsible f(3^potting 
difficulties; when he is gone, the system breaks dovm and stays 
inoperable . 

There is a tough communication problem between library staff and 
computer experts. We speak a different language. 

^ When the main computer goes down, it shuts ^ora our operation, and 
it is sometimes a long process even finding out what has( happened. 

The Beehive Company may have been less- expejnsive initially, but one 
wonders' if the supplier is not less reliable than others might have 
been . 

There is a problem with slow response time; A student enters t)ie 
linformation'and has to wait for the computer to come back with an 
&swer, due to the m^tt5)d of polling now in use. 

Personnel at the tWminal w(^re already spread too thin with all the 
other activities required of them. The time cost— for recording 
scores and monitoring operations — has been high. 



There is a problem'with any ' such mecjiani^^ the machine 

is between the student and the instrjiction. 



The need to tie into a computer ces^eV that is physically removed 
from the library operations is a bit problem. Attitudes^between 

the two groups have sometimes been less than favorable. Sometimes 
it appears that' the computer people want to be depended upon. 
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The system is inherentljr a fixed mode. There are really no 
variables in the give and take of instruction. It is pest^ suited 

• for programs with very straig^ht-fon-rard subject jnatt^r^' ^ 

5 How much mechanical expertise is needed to handle th^ t)pFferation? 

There shouldn't be much needed. Itc*ought to operate like an auto- 
mobile, where the driver knows how €p drive but .-not fix the machine. 

^he continual change in operatin<g procedures (estimated %ot 6 per - ^ 
quarter) kept things .complicated. " \ 

The need for compute^ security, and in some cases secrecj^, can" be 
'tricky. 

' GgOd basic instructions for those iavolve^^vrith the computer operations 
,» >.*'.^; are' a must, but the mechanical expertise requira;,d is very little. * <^ 

People ,at the terminal need to be able to handle small, routine' . 
procedures. ' ' " ' ^ ^ 

Virtually no mechanical expertise is necessary. People must be ab-le 

to follow written instructions, and that is about all. ,: 

/ ' ' ' 

6. . What suggestions for improved ^operation would you make?/ 

Make directions for -operation simpler and less lengtl^y. 

- Make the picture fade slower after a question ^has been answered to ^ 
allow the student to see v^hy he missed the question if he did. ' 

> , » 

• The hardware has simply got to be made more r^ablel Some sdrt - ^ 
of service agreement v^ith a 'computer company might help. 

Operators of the terminals should be interested ''and receive training 
for the job. . ' 

B ■ „ 

There should be a refresher or orientation course^ for- those involved 
with computer operations. A manual for operation— covering the Very 
' basics — should be available at all times at the terminals. 

Put the terminals in the computer center to avoid the distance problem. 

Put the terminals in a place where people have tlie necessary time to 
handle questions that arise. 

We will eventually need more terminals if the demand coijtinups to ' 
expand. For winter quarter, at least four instructors will be 
using, this system, involving 30 to Uo different programs. 

Instructions should be made simple enough that student can .bring 
the system into operation and take %teps to'overcome a malfunction. 
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There is'"a need for a simple documentation guide -i^x^tudents . 

We should "be able to simply s%n in or sign off in a very abbreviated 
fonii. 

There ought to be a single number, possibly with a recording, to tell 
when "The computer is do-^-m". 

The operation needs to gpt away from the role of a "servi(jfe desk" into 
a ijipre casual, library service type of operation. 

VJe should take a look at alternative equipment systems arid how feas^bl 
they are at this point. '^^^ ^ 

We should continually monitor the quality^f pr^>gram operations, i.e. 
an ongoing, less formal evaluation. • 

How much operator time would you estimate is involved in: \ j 

a. Explaining to a student on his ^irst time? ■ 
1-2 minutes: 2 - ' 

3-5 minutes : 2 i - 

b or^jmorb: 1 ^''"^ ^ • ^ 

No estimate: 1 

<H , , • 

b. Bringing (the terminal) up into, operation? 

1-2 minutes: 2 
3-5 minutes : 1 

i 

No estimate:^ 3 
d*. Operating when the student knows how? 
0-1 minute : 3 
No estimate: 3 

if 

d. In maintenance breakdowns: * ^ 

' This question had to be amended toask .how often, on the average, 
these were likely to occur. ^ 

Ti-ro per day 5 when many people using.- 

None in' the past two months. 
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The troAle.is that when a brealddoTO does occur, it is not 



uncommon to spend 15 minutes vi 
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h one person getting it fixed. 



This poses a problem when other people are waiting for service. 

Service on breakdown^ has been Considerably faster since last 
spring>»^ 



8. Additional comments: 

Jsf programs are written simply, 
equipment malf"unctions . 



thJre is little problem through 



^ p^-e sent ly there is a program, "Coujrsewriter" ,^ which explains the 
* V^ommands necessary for computer operation to prospective faculty 
users. An additional drive program is available entitled "USU 
^ Tocher". ^ , ' 

' i 
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A DIARY OF' COMPUTER TERMINAL ACTIVITIES 

Kept By Library Staff Members ^(2) Monitoring 
May 21-23, 197^ 



^ / 5/21/7U '•l2:U5p.m. 



8-jOO 



5/22/7U 8:5^ 



a.m* 



a.m. 



All terminals -frent down. I called the Computer 
Center, and they said they had^ some trouble and 
that in 5 minutes I should bring all thre^ ter- 
^nals up again, from the first ^step. * 

Terminals- were ail do>m last evening - they kept 
repeating:'* "enter student They'^vere o.k. 

this moilning. 

r tried to bring up the terminals.- ^he screen 
said "System problems, fcoT-m" in 10 min. for 
5 min. - Log-in denied at this time". Student 
^ left. ^ 



9:30 a.m.-^ 
10:35 a.m. 



10:55 a.m. 



12:00 noon 



^ U:00 p.m. 

10:10 aim. 

12:U0 p.m., 
1:30 p.m^ 
3:30 /p.m. 



Terminals o.ky. now. ^ ^ 

All 3 keyboards locked - I waited 5-10^ min. and 
called the computer specialist. He said wait 5 mir^. 
and try again. \ , 

The computer specialist called , us to^say the 
computer is down -*hence all terminals doTO. He 
said I should^ call operations in about 1/2 hr, to 
see if the computer is working again. He also said 
1 should keep checking the terminals to see if 
the polling light is on. The sj:udent left, 

I have been checking, and the keyboards are all 
'locked. I called the computer center and they 
have no idea when the computer will be up again. 
We are having all students sign up for new times. 

All terminals still down. 

Terminal stopped on question »13 of a student's quiz. 
Recovery system didn't work; she had to begin again. 

All terminals down - "keep repeating enter student 

O.K. now . 

All terminals down - entire screen Tilled withT*^ 
designs and numbers. I called the computer / 
specialist. He said to clear screens and try again., 
It 'didn't work. He 'said he would cl^ar every- 
thing and we should wait a bit and bring them all 
up again, from the first step. 
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6/3/7U 8:20 a.m/ I tried to bring up the terminals/ The keyboards 

vere locked. I called and vaited for the computer 
^ • specialist. I told him thp,t the keyboards were 

' locked and he said ''Have .you called operations?" 
I He transferred me^to operations , and again I waited 
When they^ answered, I told them 'what was wrong, 
' and they said they would fix it. I waited five 
minutes and checked a^ain - now the keyboard light 
uas polling. I started the procediire to bring 
them up; but. when it came td the Usercode, it kept 
* " " answering "No work file" on all the terminals. I 

called and wai^^ed for- the computer specialist; he 
« wasn't in. I waited for someone in operations - 
' - they said "we had an unscheduled cold start tM^ 

morning, check Td.th us again in about 15 minutes*" 
i watched, the screens: and in a few minutes they 
printed "Please 'log-off for 2 hburs for cold start" 
>^ AllT students left. 




PART II: STUDENTS 



What previous ^use have you made of the CAI terminals in the 
Merrill Library? 

The responses to this item vere the same for all students. All 
had been enrolled in Dr. Robert Mecham's class. Business Adminis- 
tration 360-2 5 during Spring Quarter, 197^ > and had used the CAI 
terminals to take the required quizzes for the class. 

What were your feelings about the system? ^ (favorable, unfavorable, et 

It was a new system' for me, and I was a bit jittery. After the 
first two times, I was favorable toward it. 

There was a new experience, and I had some apprehensions. As soen as 
I became familiar with it, I was favorable. 

Favorable (2) • . 

How long did it take you to get accustomed to using it? 

Aft^r the first time, it was easy. I had a good demonstration of 
how to do it. ' ^ , 

After two times, it was no problem.' 

A few minutes was all it took me. 

After I'd gone through the program once, it was easy. 
How much frustration did you- encounter in using it? 

s 

I ran into a couple of problems. One time it cut off when I was 
Jialfway through the program. Another time I got the saie questions 
2-3 times. « 

'\ _^ , 

It was annoying when the machine was down.'^ For one stretch of the 
quarter, the machine was down at least 50 to 60 per cent' of the time. 

It went well for me after the initial tries. » 

I had a problem with giving the correct answer but being marked 
incorrect. Several other students reported similar problems. 

It was inconvenient when the terminal was down. You would plan your 
schedule and then have to make adjustments to come back. 

/ 
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Would you say that this type of instruction fits your style of 
learning? 

Yes, I like the variety that the terminal gives. Also, the instant 
feedback is a help. 

Thisr was a new experience and fun for me. I like being presented 
with pne question at a 'time and getting an instant ans-^er. 

The scheduling flexi^bility was helpful to me. 

For me, this mode has more pressure on the student. It seemed that 
we had to speed up in answering. 



What things do you particularly like about the system? ; 
Convenience in scheduling. 

Immediate feedback. That way you don't get a misconception. 
The speed of operation, 

Novelty. It has to be better than ^the same old paper and pencil quiz. 
People are very helpful In showing you how to operate it. 
The system is fast and you can work at your own speed. 

What would you improve? 

The program needed to be really debugged. Reliability was a problem. 

Mechanical problems -caused a couple of breakdowns. The operator 
taught me how to carry out instructions to solve the problem, 
"Tiowever . 

The level of difficiilty of the questions shc/uld be standardized. With 
random choice operating, it seemed that some people got easy quizzes 
and others got tough ones. 

A student should be able to go back to a previous question. 

I could have used more time to see all the answers. After responding, 
it would be nice to see th^ correct answer and then compare it with 
the other choices rather than having the picture <'fade immediately. 

The beep after the question is distracting to me. 
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INTERVIEW QUESTIONNAIRE: POTENTIAL FACULTY USERS 



How did you first bec^Dme intere&ted in us,ing CAI at the Merrill 



Library? 



I- 



I talked with someone in Instructional Development , then there 
yas some interest generated in a workshop on campus dealing with 



criterion reference testing.. 



I had some exjSerience at the University of Florida which got me 
interested. When I was at Clark University there was interest 
as well, ^t that time I was interested in combining a video 
test reeor)ding with computer assisted instruction. I wrote a 
proposal which I wanted us to set up — an audio .visual tutorial 
system. , . > 



Roughly two years ago I heard^abomt ^^the arrangement through other 
meifibers of the faculty in our department. 



To what extent have you used it with your classes on campus? 

I haven't used the system at the Merrill Library* We have (developed 
a program, at the exceptional* chiNld center whicJi uses criterion 
reference testing. It is a tape prograin that lasts from 15 to 20 
minutes. 

I have written two programs which are available. I decided against 
using the system on the advice of the computer people. There was 
too much time and expense involved. 

I had wanted to use a compatible language program with a printout 
and program branching capabilities. However, I decided to use 
the hot readers at the computer center because I needed a hard 
copy (printout) and needed to have a number of programs available. 



Is 'i1? something you would recommend to other faculty members?. 
How do you feel about this system? 

Generally yes, if the program is applicalple to their interest. 



VThat featu^s are helpful' to you? 
* 

I want a positive learning experience for^my students because I 
feel that it is important that they be. faiftiliar withv this type of 
instruction. They get a good feeling when no mechanical difficult 
are encountered. 
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What problems have you encountered? 

The cost was judged prohibitive t^ our present systi'm («• hand 
record keeping system) . We use a point system and need to keep , 
track of about 150 students. , 

Wien mechanical difficulties crop up^ students don't learn and 
they pick up poor attitudes, 

■What additional uses could you- see in your field? 

Computer assisted instruction using the computer to teach could ^ 
be useful ^ut to this point has «ot been explored fully. _ 

This teaching system makes a good group exercise. You have a 
group work at the Computer tejminal and talk about, questions as • 
they^^ arise. ' . , - 

There ought to be £qpie applications in computer clas^ses. I am 
Sterestid i-n' an inSractive program with ^^^-1^^^^^ ^^,f 
or levels^ D a simple branching program for introduction. 2 > inter 
active' games such as^the investment games, 3) simple statistical , 
pfcilges for correlation with actual data, and k) an actual prcblem 
" situation where \hQ computer is used tV solve a problem. 

What suggestions would you have for improved ujage? 

We like using it in the library because of Ideation and later 
hours.. Ifwould help us to keep the library use open at least 
through 10 o'clock at night. ' - . ■ 

There needs to be' a sMlled person oh hand to log. the students 
oria-or to troubleshoot mechanical problems. 

We could use a. program that^would give us a hard copy printout. 

It "seems to me th^ accessibility 's the key to-nse in this program. 
The terminal should be put into the place where all can usb it. 
It.X)ught to be made available to the professors who want to use it, 
and" we. ought to encourage its use. 

We need' to remember that the time of students is valuable. ^ 
* We need to maximize the benefits of the computer in the minimum 
^ amount of time. 
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INTERVIEW QUEST lOMAIRE: FACULTY USERS 



"How did you first becgme interested in using dAI at the Merrill 
Library? . * " 

I vjas interested in frequent testing with immediate feedback, and 
I was having a problem with makeups, . I got in1>>^rested in a test 
scoring program through the computer and have gone ahead with that, 

.a \ 
Through Instructional Development. When I first started work in 
this center I did not presently, use the terminals at the Merrill 
Library. 

We hav^ presently quite a few computers in our own department. We 
have a portacon and a mini-computer. I became interested 'in the 
terminals in the library beeuupe we need more space and this could . 
save us money. 

We have a shortage of teletypes now, I think we can generate enough 
"work to keep 12 tenninals busy. 

To what extent have you used it \T±th your classes on campus? 

So far we have two programs as supplementary to a statistics class. 
We are presently working to get a compute assisted instruci>ion 
package* available. 

We use it for unit quiz as; testing students each quarter, I 
previously had two programs which allowed students to take exams 
at their own schedule with -yiree re-takes possible. We had to 
phase this out due to unreliability of the system. 

« 

We have computer tenninals in 6ur own department > which we use for 
testing programs in three classes—one using five quizzes, one 
using three quizzes, and one using six quizzes. 



ISw it something you v/ould recommend to other faculty members? 
How do you feel about this system? 

I am favorably disposed to CAI in general. It eliminates major 
problems in scheduling and monitoring quizzes. 

Good. I would like to see 30 to hO terminals here on campus. 
We might take a I'esson from the Air ."Force Academy where hot . 
reader.s and computer terminals are available to practically any 
student for practically any class* .j^ 

I would recommend it to', some faculty members;" however, they do 
need to be able to take some frustration .because the system ^does 
not always operate as anticipated. , 
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I can't recommend it at this time since in our o\m case vre had 

to discontinue use due to unreliability. We hope that this can be 

improved; and if the .bugs vere talten out, it has. real potential. 

I'Jho.t features are helpful to you?- 

We have developed our^ o\m testing program ^-/hicii gives, tjie instructor 
his test score for each conceptual area. He ean spot areas of 
strength and vealmess quickiy for each student. . 

It' seems to me that teaching programs should have priority over 
testing progradis. For. one thing, testing is considerably cheaper 
using other means. ^ * . 

It eliminates the repetitive nature of record keeping and quiz 
administration. The time saving alone" is v^Jp^^'^luable. , 

In theory the system is really a good one. Students se|m to like it, 

{> 

What problems have you encountered? 

At first \re had a problem meshing our equipment with the system at 
the computer center. We had a dot of dovm^ time at first."" I should 
say there has been a 10,000 per qent improvement since then. It 
works quite smoothly npw. / 

It is difficult to provide instructions that are simple and that 
can be usedtj^by the student. 

The programs have to be adapted to match >7lth the central system. 

There seems to "be a problem in tying up library personnel for what-"' 
is essentially a control function — test security. 

Mainly our problems have been mechanical in nature. It s'eems like 
ve are conti-nually debugging. It seemed that the terminals kept 
breaking do™. 

Do you^'harve a baCckup system? What is it?. ^ 

Yes. If necessary, we use the teaching assistants to grade the 
print o\its. \ • 

Yes, a hard copy system which we have had to use two ^r three times. 
Th@jj)rogram is set up to simply print- out the quesLior^s which the 
student can then respond to. 

\ 

There is no need for a*^ backup system* Repair^ can be taken care of 
soon enough ^j^hat it woul^ be more trouble than it is worth. 



Yes. The papei? and pencil quizzes are available with the secretary- 
like \Te had before we set up tliis CAI program. 

VJhat additional uses could you seo in. your fi^ld? 



It seetos to me 4t cov^ be used for ta^aching if the course content 
is not changed much from quarter to quarter. VJe are- pre-modualising 
some courses. , 

There have been cost reductions in this kind of equipment in the same 
way that calcula^ork have been reduced in price. It seems to me that 
they wi^,l benjome morevavailable at lower prices in the future. 

Some other people in oiujt^e^artment could likely use tMs type of 
program. ^ - 

There ought to be some iy^&o-use these facilities in research. 
Statistical work can t lona in a similar manner that we now use 
a teletype syst^em. Tl. same computer terminal that is used to 
instruct can also be ui ed for innovative work. 

There is a way to ust=* the computer terminal for monitoring — Computer 
'Assisted Monitor (CAMS). This system can be used for keeping trg.ck 
.of wheire a child is in thQ process of teaching.- It gives the teacher 

immediate feedback and records data for research at the same time. 

J 

what suggestions would you have for improvement us^'age? 

We have been able to get many of the bugs out of the program now, 
and it seer::: to me that there should be a summer training for the 
j^2^rsonnel who monitor the terminal.. There should be someone :^ith^ 
experience handling monitoring difficulties. 

As.buon as all the bugs are out of it ^ I vanu to go ahead witli our 
program. Students need an' orientation session. They ought to have • 
about five preCctice. sessions Just to learn how it works. 

Tliere are quite a few options for instructors which as soon as we 
feel the programs are reliable should be presented to others; It 
seems to me that ^ it is a good idea for a workshop. We need manpov/er 
available on the job with computer science training. 

With slight modifications we could put a "multiplexer" unit to 
compress the messages. LiTie cost would remain the same, and speed 
would be increased greatly. 

These terminals ought to be used for teaching rather than testing. 

Why couldn^'t the' people in the engineering department be u§ed to 
set up internal telephone lineg? The network is already there. 
They would simply have to string the lines. Why pay BeU^Telephone 
for a line we could put in Just as easily ourselves? 
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It seems to me that computers that are presently being used for ^ 
administrative pxirposes should be made available for student 
instruction after hours. ^ ^ 

As .there are peali periods in administrative Hse, it should be ^ 
poss^ible to cut doTO the computer use by administration—possibly 
ti'/o hours in the morning and tvo hou'rs in the afternoon — and then 
free up t]ie lines, for instructional use. 1 recognize there woi^ld 
be some monitoring problems, but I think these could be overcome 
easily. ' * 

We need someone to handle information systems on cajnpus 5 a central 
•^plan-ning agency instead of a haphazard proliferation of computer 
terminals. *f . 

One thing that 'is 'in/the process of being implemented now is a ' 
general University budgeting account, rather i^han having to keep 
track of each accoiint separately. When the Jc|b is less than five 
seconds, it can be billed to the central accqti^it. We feel that 
it increases "the probability and makes 'pdopl4 Jess reluctant to use 
- the ^service-. This shou>dr^e avai-lable very socpn. 
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appendix' c 

An Explanation of Calciilations 
of Costs And Benefits 



To MLLRP - 

Initial Cost Of Terminals 

CRT 1*5-1-2793'^ PurcHased May, 1972 ' $2,582 

CRT U5-I-281U Purchased March, 1973 2,500 

CRT U5-I-2815 Purchased March, 1973 . 2,500 

TOTAL * $7,582 

(Source: Inventoiy Records) 

With the^r^id advance of computer technolo^, equipment is generally 
considered obsolete in three years and fuctional for eight years. * 
Depreciation over five years represents a medium point. However, 
the alternative depreciation schedules at differing rates of 
interest and at different interest rates are as follows: 

AMORTIZATION OF $7600 
Monthly Payment^ 



Period 

of Time Interest ^Rate 

65S 



3 years 231.22 238.17 2U5.2U 

5 years ^ IU6.9U 15^-11 161. U9 

8 years 99.89 107-^+5 ' 115.33 

(Source: Federal Building and ^ Loan Monthly Mortgage 
Calculator For Conventional And F>H>A> Loans , Boston, 
MassgTohusetts : Financial Publishing Company, 19T3) 

The interest rate choXen is purposely lov. Any money obtained in 
1972 would have been more expensive, probably .considerably. 
This figure represents interest^ foregone'^y having money invested. 
Once again, the' low interest rate (6^) has been chosen. Money 
plaqed in a tim6 deposit for five years at any insured bank would 
earn considerably more. . 
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B. Cost of floor space: This could be ' calculated quite precisely 
as a proportion of' the total area in the library. The estimate 
($25) is considered conservative \fhen the folloTfing considerations 
' are included: ' ^ 

Depreciation of building costs X 
Cost of utilities: lights, heating, T^er, sever 
Janitorial service ) 
Proportion of expense for stairs, lavatories 
Rent of tables the terminals rest upon 

.This calculation was not made because the total are a^ for CAI 

use (estimated 60 square fe^et) was not large enough tp justify 

the effort involved, 
II. A. 1. This cost,- monthly equipment cost, is paid diVectly to the 

telephone company and concerns the complex equipment Involved 
/ . in the' polling operation. (Source: Telephone bill Tor 

Instructional Development) 

2. This cost, paid to\thp/computer Center, cover? the line cost. 
(Source: Computer bill for l^nstructional Developm^t) 

3. The telephone line for the ^terminal. (Source: Telephone bill for 
Instructional Developmi^nt ) 

k. The maintenance cost 'for the terminals to date has been handled 
as needed, whenever terminals were not functioning* An effort 
was not made to go back and total all maintenance expenses 
to date, since maintenance was judged unsatisfactory. The present 
arrangement has been expensive. . ^ ' • 

Rates quoted by the sales representative at Beehive Medical 
Electronics, Inc, as the present price of service agreement through 
Sorbus or SEM was $350 per year per terminal. ($37-50 per month 
for three terminals) It is likely this could be reduced for 
three terminals together. 
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The figure \jsed is "based upon^ the specialist's ?sti^ation that . 
this, program d±d not require more than one or two hours per 
vxeek. ^ 



The present progranmer pay schedule is as follows: 
Junior - $6/hour; Senior - $9/hour; Lead (Professiondsl^ - $ll/hour 
Assuming that the top category represents the programmer 
employed to wite this program, a total cost of $1^96 is 
calculated. 

An additional $50U is added in to cover 
l) Unanticipated programmer time - 
"2) Tryout expense, debugging the program 
3) Later expenditures to improve the program 

B. Opportunity Cost: The same 'basis for calculation described 

for MLLRP. " ' 

C. Instructor time cost in program development, admittedly quite 
extensive in this case, is not computed for two reasons: 

(l) a mini grant from MLLRP for $300 was figured into the fixed 
costs and (2) it can be assumed that alternative quiz proi ^dures 
' would have ,to have been developed, probably quarter after quarter, 
which would be roughly equivalent to this program. 
II. A. The monthly charge for computer use was the average of the previous 
five months billing for "on line storage" ($Ul.50). The division 
into "Data Storage" and "Computer Time In Use" was obtained by 
the instructor's estimate of $15 to $20 per month for data 
storage. The charge for computer use is seen to increase over 
a one-quarter period. 
B. The cost of the computer specialist to troubleshoot has been 

covered by the Business Administration Department. It becomes a 
difficult item to estimate due to the -sporatlc nature of calls 
for service and because the nee^ for these calls has fluctuated. 
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•ffee estimate of $^0 per month is based upon use of a qualified 
maintenance person in Logan. It covers labor, (at $12 -per hour), 
parts, mileage, etc. 

Personnel Cost: This estimate assumes minimal administratic 
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plus one^fifth ti]ft^^f the person monitoring (c.a. $3 per hour). 
Present hours of terminal accessability are as follows: 



... V 
Monday-Thursday » 8:00 a.m. -5:00 p»m., 7:00 p.m.-10':00 p.m. 

Friday • 8:00 a.m. -5: 00 p.m. 

/ Saturday 11:00 a.m. -9: 00 p.m. 

Sunday j 1:00 p.m. -9:00 p.m. 

Total hours: 75 per week. Figuring four weeks per month allows 
for holidays, schedule changes during quarter breaks, etc., 
comes to 300 hours per month. It^is recognized that the work 
loa^^jj^ll be heavier in some portions of the quarter and lighter 
in others. If weekend access to the terminals is not provided, 
cost is estimated at $232 per month. ^ ^ 

Costs To Business Administration Department 
I. A. Program development 'costs were estimated on the basis of programmer 
time involved by the technical specialist/troubleshooter as follows: 

Writer Test ^0 hours 

Analysis _ ' 30 hours 

Summary f ^ 25-30 hours 
Paper Test 10 hours 

Questionnaire 20 hours 

Master File 3 hours 

Files 1-5 hours 

■ Class Files 1*5 hours 

TOTAL 136 hours 
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APPENDIX D 

A' List Of Persons Interviewed Or .Telephoned 
^''^ In Conducting This Study 




Bonnie Rae Anderson, student 

Douglas Alder, Department Head, Honors Program ^ 
Sherry Berlage, Audio-Visual Assistant 

Floyd J. Burnett, Assistant Professor, Computer Science 
Cliff Craig, Instructor^ History and Geography 

Michael DeBloois, Associate Director, Instructietial- Development 

Clark M. England, Coordinator, Aujciliary Accounting and Communication 
Services 

Donna Forsburg, Accounts Controller, Computer Center 

Katheryn Gardner, Assistant Professor, Instructional Media 

LaDell C. Hoth, Assistant Professor, Instructional .Media 

Rex L. Hurst, Professor and Department Head^ Applied Statistics 
and Computer Science 

BrUce Israelson, student 

Harold Lynch, Pro grajnmer , ' Computer Center 

Robert C. Mechara, Associate Professor, Business Administration 
Devere E. Miner, Inventory Clerk, Controller's Office 

Rebecca S. Mitchell, Instructor, Home Economics and Consumer Education 
Marian D. Nelson, Associate Dean, Humanities, Arts, And Social Science 



Max 



P. Peterson, Associate Professor and Associate Di^^ector MLLRP 



ERIC 



\ 

Richard B. Powers, Associate Professor, Psychology 

Of ' ^- ' 

Darrell Sanders, Student 

Tom Sawyer, Assistant Audio-Visual Librarian, MLLRP 

> 

{ William F. Sigler, Professor Emeritus, Wildlife Science ^ 

Robert H. Stocker^ Assistant Professor, Business Education and 
Office Administration 

Geneva Taylor, Student 

Ron Thorkildson, Instructor, Computer Science ^ Business Administrator, 
Exceptional Child Center 

R. Kent Wood, Assistant Professor, Instructional Media* 
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Robert D. Woolley> Reference Librarian, MLLRP 

Gary E. Wright, Loan Officer, Federal Building and Loan 
Salt Lake City, UT 
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